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FOREWORD 


The  work  reported  was  accomplished  by  the  Personnel  and  Training  Requirements  Section, 
Training  Research  Branch,  Behavioral  Sciences  Laboratory,  Aerospace  Medical  Research 
Laboratories,  under  Project  1710,  "Training,  Personnel,  and  Psychological  Aspects  of  Bio- 
astronautics",  Task  171005,  "Technical  Guides  for  Designers  of  the  Personnel  Subsystem  for 
New  Weapon  ^sterns.  "  The  study  was  completed  in  September  1961.  Draft  copies  of  the  report 
were  concurrently  distributed  to  interested  Air  Force  agencies  in  November  1961. 

The  present  report,  a  companion  to  ASD  TR  61-447,  "A  Data  Organization  Model  for  the 
Personnel  Subsystem, "  was  prepared  to  support  both  the  Air  Force  and  contractor  applied 
Personnel  Subsystem  (PSS)  efforts.  Methods  and  techniques  for  implementing  the  relatively  new 
PSS  concept  are  constantly  being  developed,  revised,  and  Improved;  changes  which  occurred 
subsequent  to  August  1961,  have  nut  been  Incorporated  in  the  report  —  e.  g. ,  Personnel  Subsystem 
will  be  abbreviated  PS,  the  PSS  elements  or  milestones  will  number  twelve  rather  than  the  cur¬ 
rently  familiar  nine,  and  MIL-R- 26674  has  been  superceded  by  MIL-R-27542,  (although  the 
official  date  of  MIL-R-27542  is  28  June  61,  copies  were  not  available  prior  to  the  completion  of 
the  study).  In  view  of  the  dynamic  nature  of  the  Air  Force  specification  structure,  it  was  neces¬ 
sary  to  establish  a  cut-off  point  for  updating  the  written  material  or  the  publication  of  the  results 
would  have  been  endlessly  delayed.  We  felt  that  sufficient  groundwork  for  specifying  PED  had 
been  laid,  and  it  will  be  the  responsibility  of  weapon  system  development  personnel  to  keep 
abreast  of  the  current  state  of  PSS  development,  and  to  judiciously  supplement  the  inform^ion 
contained  in  this  report. 

Especial  thanks  are  due  Mr.  Melvin  T.  Snyder,  Chief,  Personnel  and  Training  Requirements 
Section,  for  his  interest  in  this  work  and  for  his  helpful  guidance  throughout  the  course  of  the 
study.  The  authors  are  also  very  grateful  to  personnel  at  Douglas  Aircraft,  Culver  City,  Cali¬ 
fornia,  Lockheed  Aircraft,  Burbank,  California,  North  American  A\ *ation,  Columbus,  Ohio  and 
Los  Angeles,  California,  who  contributed  to  the  authors'  understanding  of  data  flow  and  Person¬ 
nel-  Equipment  Data  implementation  problems  within  their  organization. 
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ABSTRACT 


Consideration  of  the  degree  of  uncertainty  surrounding  Personnel- Equipment  Data  (PED), 
one  of  the  Personnel  Subsystem  Elements  (PSS),  led  to  the  present  attempt  to  empirically  define 
the  content  of  PED,  and  to  identify  requirements  contained  in  Military  Specifications  and  related 
documents  which  can  and  often  do,  generate  unnecessary  duplicative  effort.  Eighteen  documents 
deemed  relevant  to  the  study  were  scrutinized,  and  requirements  calling  for  the  submittal  of 
data  were  extracted.  A  list  of  these  requirements  and  their  locations  is  presented.  The  amount 
of  duplication  tending  to  bring  about  redundant  work  effort  was  less  than  anticipated,  but  sufficient 
to  provoke  a  good  deal  of  concern.  A  few  sources  of  unnecessary  duplication  of  effort  are  dis¬ 
cussed,  and  suggestions  which  can  help  eliminate  duplication  are  presented. 


PUBUCATION  REVIEW 


WALTER  F.  GRETHER 
Technical  Director 
Behavioral  Sciences  Laboratory 
Aerospace  Medical  Research  Laboratories 
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PERSONNEL  EQUIPMENT  DATA:  CONCEPT  AND  CONTENT 


INTRODUCTION 


Fifty  years  ago  it  was  possible  for  a  few  people  to  completely  design  and  fabricate  a  weapon 
system.  World  War  n  weapons  were  very  complex  compared  to  their  predecessors,  but  it  was 
still  feasible  for  an  sdrframe  contractor  to  Integrate  subsystems  developed  by  other  manufacturers 
into  a  weapon  system.  Components  and  accompanying  skills  were  easily  interchanged  between 
systems. 

Present  system  requirements  for  increased  range,  speed  and  altitude,  a  higher  degree  of 
accuracy,  etc. ,  accompanied  by  tremendous  advances  in  the  electronics,  propulsion,  armament, 
and  other  scientific  fields,  paved  the  way  for  the  Weapon  System  Concept.  Tlie  basic  tenet  of  this 
concept  is  to  promote  the  design,  production  and  management  of  the  weapon  system  as  an  inte¬ 
grated  effort  Instead  of  a  series  of  individual  efforts.  As  examples  of  increased  system 
complexity,  one  has  only  to  note  that  it  took  approximately  48  years  from  the  time  of  the  Wright 
Brothers  to  reach  Mach  1,  an  additional  8  years  to  reach  Mach  2,  and  increased  speed  has  been 
attained  in  an  even  shorter  time  period.  Engineering  manhours  expended  have  increased  from 
approximately  7000  per  month  for  the  B-17  to  over  100, 000  per  month  for  the  B-70.  Systems  are 
being  designed  to  perform  specialized  missions  with  a  resulting  decrease  of  interchangeability  of 
parts  and  personnel  between  systems.  Not  only  have  the  weapons  become  more  complex,  but  so 
have  the  ground  support  equipment  (now  aerospace  ground  equipment),  training  techniques  and 
training  equipment  and  the  operational  organizations.  Equipment  and  personnel  lead  times  have 
increased  while  development  times  have  diminished,  necessitating  greater  management  control 
over  the  develcvment  of  the  modern  weapon  system. 

Several  systems  developed  prior  to  the  formulation  of  the  Wei^wn  System  Concept  (e.  g. ,  the 
F-86)  conclusively  indicated  the  need  for  management  techniques  that  would  insure  the  avail¬ 
ability  of  all  system  components  by  the  scheduled  dates.  No  longer  would  a  delay  in  the  opera¬ 
tional  status  of  a  system  be  tolerated  because  trained  maintenance  and  operational  personnel  were 
not  available.  Personnel  must  be  considered  an  integral  part  of  the  total  system,  and  appropriate 
measures  should  be  taken  during  the  very  early  system  planning  phase  to  determine  the  kinds  and 
number  of  personnel  required  for  the  system.  To  do  otherwise  would  place  the  schedules  and  the 
ultimate  success  of  the  system  in  jeopardy. 
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The  Personnel  Subsystem  (PSS)  concept  was  predicated  on  the  need  for  the  development  of 
personnel  siqpport  of  a  weapon  system  concurrently  and  integrally  with  the  system  hardware: 

"The  Personnel  Subsystem  of  a  weapon  system  is  a  composite  of  the  trained  military  personnel 
and  employment  techniques  required  to  operate,  control,  and  maintain  the  integrated  hardware 
subsystem  of  the  weapon' system. "  ^  The  major  elements  required  in  the  development  of  the  PSS 
are: 

1.  Personnel  Equipment  Data  (PED) 

2.  Human  Engineering 

3.  Quantitative  and  Qualitative  Personnel  Requirements  Information  (QQPRI) 

4.  Training  Concept 

5.  Training  Plans 

6.  Training  Equipment  Planning  Information  (TEPI) 

7.  Training  Equipment  Development  CTED) 

8.  Technical  Orders  and  Technical  h^uals  (TOTM) 

9.  Personnel  Subsystem  Test  and  Evaluation  (PSTE) 

Personnel  Equipment  Data  (PED) ,  the  primary  concern  in  this  report,  is  defined  in  the  PSS 
Management  document  as  "A  centrally  maintained  body  of  analytical  data,  in  the  form  of  task 
and  equipment  information,  that  defines  the  interrelationship  of  functions  performed  by  system 
people  and  system  hardware. "  ^  PED  should  be  a  complete,  accurate,  and  iq>-to-date  pool  of 
basic  data  which  supports  the  preparation  and/or  the  development  of  the  entire  PSS  .  tt  is  the 
contractor' s  responsibility  throuj^out  system  development  to  prepare  and  maintain  PED  as 
accurately  as  possible  and  to  insure  that  data  will  be  readily  avsdlable  to  those  agencies 
responsible  for  PSS  development. 

One  may  readily  note  vagueness,  problems,  and  perhi^;>s  inconsistencies  inherent  in  the 
above  definition  and  discussion  of  PED.  The  statement  that  PED  will  be  composed  of  task  and 
equipment  Information  lacks  explicit  detail  concerning  the  data  actually  required  and  the  source 
data  needed  to  derive  the  PSS  elements.  The  dynamic  quality  of  system  development  represents 
an  interesting  challenge  to  the  utility  of  the  basic  data  pool.  The  data  pool  must  be  capable  of 
sjqianding  and  adjusting  as  new  data  are  generated  to  insure  that  the  necessary  storage,  retrieval, 
and  iqxiatlng  can  be  accomplished  in  an  accurate  and  timely  fashion.  The  support  of  TOTM,  a  PSS 
element,  necessitates  that  PED  be  much  broader  in  scope  than  initially  conceived;  thought  must 
be  given  to  the  data  pool  as  encompassing  practically  all  system  data. 

The  magnitude  of  modern  weapon  system  development  requires  Air  Force  wide  participation 
with  assistance  from  Industry.  Dwuments ,  such  as  military  specifications,  bulletins,  exhibits, 
and  handbooks,  are  the  means  by  which  the  Air  Force  provides  the  multiplicity  of  contractors 
with  the  quldance  necessary  to  fulfill  weapon  system  requirements.  The  data  requested  in  those 
documents,  which  now  will  contribute  to  PED,  originated  in  various  Air  Force  agencies  and  were 
intended  to  serve  different  purposes.  Some  of  the  data  requested  in  various  Military  ^)eciflcations 
and  related  documents  tends  to  be  quite  similar,  and  in  some  Instances  are  exact  replicas.  In  the 
vast  contractor  and  subcontractor  organizations,  if  a  combination  of  a  degree  of  unawareness 
concerning  the  specifications  and  a  lack  of  communication  between  working  grotqM  exists  unnec¬ 
essary  <hq>licatlon  of  data  may  be  promoted  (e.  g. ,  very  similar  task  analysis  data  could  be 
generated  by  a  grotq>  primarily  concerned  with  the  maintainability  aspects  of  a  system,  and  also 
by  a  group  working  in  the  personnel  requirements  area).  Some  integration  of  the  now  sufficiently 
well  established  requirements  for  obtaining  the  trained  Air  Force  ctqMbility  to  operate  and  main¬ 
tain  present  systems  is  possible  and  should  result  in  savings  of  funds,  time,  and  technical  man¬ 
power. 


^Personnel  Subsystem  Management.  Joint  ARDC  -  ATC  Policy  On  Management  Of  Personnel 
Subsystem  Development  For  Weapon  /Supporting  Systems,  1  February  1960,  p.  1 

*Ibld;  p.3 
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The  above  discussion  Indicates  the  need  for  the  present  study.  This  stiidy  empirically  defines 
the  content  of  FED  and  Identifies  those  requirements  ^ipearlng  In  selected  military  specifications 
and  related  documents  that  may  lesul  to  unnecessary  dvqpllcatlve  effort. 


METHOD 


The  task  at  hand  was  to  examine  the  military  specifications  and  related  documents  that  have 
PSS  Implications  and  to  develop  a  technique  for  identifying,  extracting,  and  recording  the  require¬ 
ments  contained  therein. 

Selection  of  Documents 

The  present  study  was  confined  to  those  military  specifications,  exhibits,  and  standards 
that  would  contribute  to  FED  (and  therefore  FSS  development).  Many  military  specifications  and 
related  documents  were  reviewed  and  the  following  were  selected  as  relevant  to  this  study: 

MIL-D-PSIOB  Data  for  Aeronautical  Weapon  Systems  and  Siq>port  Systems 

MILp-W-9411A  Weapon  Systems:  Aeronautical,  General  Specification  For 

MIL-D-9412C  Data  For  Grotind  Support  of  Weapon  Systems,  £hq>port  Systems,  Subsystems, 
and  Equipment 

MIL-D-26239A  Data,  Qualitative  and  Quantitative  Personnel  Requirements  Information 

(QQi»RI) 

MIL-M-26512A  Maintainability  Requirements  For  Weapon,  Support,  and  Command  and 
Control  Systems,  and  Equipment 

MIL-R- 26674  Reliability  Requirements  For  Weapon  Systems 

MIL-H-25946  Human  Factors  Data  For  Manned  Aircraft  Weapon  Systems 

MIL- H- 26207  Human  Factors  Data  For  Guided  Missile  Weapon  Systems 

MIL-T-27382  Training  Equipment,  Sidwystem,  Technical  Data,  Preparation  of 

MIL-T-27474  Training  Equipment,  Ground,  General  Requirements  For 

MIL-T-9212A  Trainer,  Flight  Simulator,  General  Specification  For 

MIL-T-25304A  Trainers,  Cockpit  Procedure,  General  Specification  For 

MIL-T-6328F  Trainers,  Flight  Equipment,  Aircraft  or  Missile  Components,  Mobile, 
General  Specification  For 

MIL-T-4860C  Trainers,  Operational  Procedure,  General  Requirements  For 

MIL-T-8823  (ASG)  Training  Aids,  Aircraft/Missile  Systems,  Animated  Panel,  General 
Specification  For 
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MIL-STI>-80S  Human  Engineering  Criteria  For  Aircraft,  Missile,  and  Space  Systems, 
Ground  Support  Equipment 

MIL-P-2596  Procedures  for  Development  of  a  Cockpit  Subsystem  and  the  Accomplishment 
of  Systems  Integration 

AFBMD  EXHIBIT  60-1  Personnel  Subsystem  Testing  For  Ballistic  Missile  And  Space 

Systems 

The  original  Intent  was  to  limit  the  Investlgaticm  to  those  specifications  having  Air  Force  wide 
distribution.  However,  an  exception  was  made  to  include  AFBMD  Exhibit  60-1,  because  it  was 
the  only  document  found  which  provided  PSTE  requirements. 

Extraction  of  Requirements 

A  set  of  rules  was  needed  to  determine  exactly  which  requirements  in  the  specifications 
should  be  extracted  and  submitted  to  further  analysis.  Since  a  primary  interest  of  the  study  was 
to  define  the  limits  of  PED,  it  seemed  pertinent  to  record  all  the  PSS  related  requirements  for 
which  the  contractors  must  submit  data.  At  times,  data  is  sidbmihed  to  Indicate  adherence  to 
certain  principles  and  criteria  listed  in  the  speciflcaticms,  e.  g. ,  maintainability  principles,  even 
though  they  w  not  requirements  in  the  strict  sense,  and  do  not  necessarily  request  the  sub¬ 
mission  of  data.^  Therefore,  two  basic  guidelines  were  formulated  for  extracting  requirements 
from  the  specifications  listed  above.  These  were: 

1.  Record  all  personnel  related  requirements  for  which  the  contractor  mi^  submit  data. 

2.  Record  sdl  principles  and  criteria  which  could  warrant  data  sdbmittal. 

As  is  often  the  case,  some  terms  warrant  further  clarification.  The  expression  "personnel 
related  requirements"  posed  the  problem  of  establishing  a  cut-off  point  on  a  personnel-equip¬ 
ment  continuum  that  w(^  help  determine  whether  or  not  a  particular  requirement  was  within 
the  range  of  this  study.  Although  not  presented  as  a  continuum,  figure  1  may  help  illustrate  the 
complications  Involved  in  Identifying  pertinent  requirements  to  be  extracted  from  the  specifica¬ 
tions.  Area  E,  in  figure  1,  pertains  to  those  requirements  related  directly  to  equipment,  and 
having  no  personnel  linkages  (e.  g. ,  metal  stress  testing).  Requirements  represented  by  Area 
P  pertain  only  to  personnel  and  are  not  related  to  hardware.  Lastly,  Area  P-E  represents  those 
requirements  indicating  personnel  and  equipment  interrelationships  (e.  g. ,  color  coding  of  elec¬ 
tronic  components  for  ease  oi  maintenance).  The  limits  of  the  areas  depicted  in  figure  1  were  set 
forth  to  permit  greater  facility  for  identifying  and  extracting  relevant  requirements  from  the 
specifications  and  were  not  intended  to  constitute  a  rigid  definition  of  the  areas. 


P-E 


E 


Figure  1.  System  Data 


^Some  feel  that  adherence  to  principles  and  criteria  is  implied  if  the  weapon  system  has  met  the 
operational  requirements,  and  therefore,  data  submittal  is  unnecessary. 
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The  present  study  was  concerned  primarily  with  the  personnel  and  the  personnel-equipment 
requirements  represented  by  Areas  P  and  P-E  respectively.  Accordingly,  the  preliminary  phase 
of  the  study  was  devoted  to  Identifying  and  recording  personnel  and  personnel-equipment  recj^re- 
ments,  while  eliminating  those  requirements  dealing  soleiy  with  equipment  (Area  E).  No  attempt 
was  made  to  differentiate  between  personnel  (Area  P)  requirements  and  personnel-equipment 
(Area  P-E)  requirements  at  this  point. 

Several  methods  (e.  g. ,  McBee  Cards,  IBM,  outlining,  etc. )  were  considered  for  recording 
the  requirements  extracted  from  the  specifications,  but  adequate  flexibility  for  handling,  filing, 
and  an^yzing  the  data  was  afforded  simply  by  using  blank  3  by  5  cards.  Each  document  was 
scrutinized,  and  requirements  deemed  pertinent  to  the  study  were  Individually  recorded  on  the 
cards,  along  with  the  specification  number  and  the  paragraph  number  within  the  specification  in 
which  the  requirements  appeared.  The  considerable  accumulation  and  diverse  nature  of  the 
requirements  Initially  abstracted  and  recorded  on  the  cards  directed  attention  to  the  need  for 
providing  a  logical  framework  for  the  recorded  information.  Previous  attempts  to  classify 
requirements  proved  to  be  quite  inadequate  because  the  basis  for  the  classification  was  sub¬ 
jective  and  suited  the  documentation  used  In  Air  Force  WetqKMi  System  development  programs. 
Accordingly,  It  was  deemed  that  the  framework  be  empirically  determined. 

An  unanticipated  and  interesting  paradox  came  to  light  after  the  requirements  had  been  ex¬ 
tracted  from  the  specifications  and  summarily  recorded  on  the  cards.  Vigorous  interest  In 
relating  requirements  to  each  other  and  to  PED  subverted  the  fact  that  by  extracting  require¬ 
ments  from  the  source  documents,  relationships  among  the  requirements  as  they  originally 
aq>peared  were  sacrificed.  On  the  one  hand,  an  attempt  was  being  made  to  establish  Inter¬ 
relationships  between  requirements  which  would  enhance  the  objectives  of  the  present  Investi¬ 
gation,  while  on  the  other  hand,  existing  relationships  were  being  eliminated. 

The  following  four  approaches  were  considered  for  organizing  the  recorded  information: 

1.  Alphabetical  order 

2.  Order  of  Importance 

3.  Weapon  system  development  phase 

4.  Common  factors 

Although  ordering  the  cards  alphabetically  would  have  provided  the  desired  objectivity,  this 
method  was  not  adopted  because  relationships  between  requirements  could  not  be  indicated  and 
because  of  the  problem  of  selecting  a  representative  word  to  alphabetize  the  requirement.  The 
second  method,  order  of  Importance,  provided  a  logical  framewoik  for  organizing  the  require¬ 
ments,  but  was  also  discarded  because  establishing  an  order  of  Importance  among  the  require¬ 
ments  was  too  subjective,  and  In  many  other  ways,  impractical.  The  third  approach,  catego¬ 
rizing  the  requirements  according  to  the  weapon  system  development  phase  during  which  the 
data  orglnate,  was  eliminated  from  consideration  because  it  proved  to  be  extremely  difficult  to 
determine  exactly  when  all  the  data  are  derived.  Lastly,  forming  categories  based  on  the 
requirements  and  placing  requirements  having  common  elements  In  the  same  category  was  the 
method  adopted  for  the  study,  since  It  provided  structure  while  remaining  relatively  ^jectlve. 

Initially,  the  entire  deck  of  cards  was  sorted  Into  small  groups  having  similar  requirements, 
e.  g. ,  requirements  pertaining  to  human  performance  under  varied  environmental  conditions  were 
all  placed  in  the  same  group,  those  requirements  dealing  with  malntainbillty  and/or  maintenance 
data  were  placed  In  another  group,  etc.  In  this  manner,  each  small  grotq)lng  of  cards  came  to 
represent  a  particular  category  composed  of  similar  requirements.  As  the  Investigation  con¬ 
tinued,  the  initial  categories  resulting  from  the  collection  process  were  repeatedly  refined  until 
suitable  categories  were  attained. 

The  next  step  was  to  select  category  titles  that  objectively  described  the  requirements  con¬ 
tained  therein.  A  brief  examination  of  the  titles  clearly  indicated  that  two  rather  broad  headings 

- Personnel  Requirements  and  Personnel- Equipment  Requirements - neatly  subsumed 

practically  all  of  the  categories.  The  few  remaining  categories,  which  could  not  readily  be 
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assigned  to  either  the  Personnel- Equipment  Requirements  or  Personnel  Requirements  classifi¬ 
cations,  uniformly  fit  under  a  third  major  classification  consisting  of  those  categories  whose 
requirements  pertained  to  the  total  weapon  system  (e.  g. ,  system  description,  design,  operations, 
etc). 


Since  one  of  the  main  objectives  of  the  study  was  to  identify  those  requirements  that  might 
tend  to  generate  dvplicatlve  effort,  a  need  existed  to  organize  tte  information  recorded  on  the 
cards  in  a  manner  that  would  facilitate  comparing  requirements.  The  need  was  met  by  con¬ 
structing  a  chart  in  which  the  columns  represented  the  documents  and  the  rows  represented  the 
requirements,  thus  forming  a  matrix  of  paragraph  numbers  (figure  2). 


Requirements 

Specifications 

9310B  26239A 

26512A 

. 1 . 

3.  4.8.2. g 

3.3.1 

2 

App  I.  4/4-1  2.  2 

3 

3.1.1 

3.3. 1 

Figure  2.  An  Illustration  of  the  Working  Charts 


Note  that  the  first  requirement  listed  in  figure  2  can  be  found  in  paragraph  3. 4. 8.  2.  g  of 
MIL-D-9310B  as  well  as  in  paragraph  3. 3. 1  of  MIL-M-26512A.  Similarly,  the  third  requirement 
can  be  found  in  two  of  the  three  specifications  included  in  figure  2. 

Duplicate  requirements  appearing  in  the  selected  documents  were  identified  concurrently  with 
the  transfer  of  information  from  the  cards  to  the  chart.  It  was  necessary  to  refer  repeatedly  to 
the  source  documents  to  ascertain  the  degree  of  similarity  between  seemingly  duplicative  require¬ 
ments,  because  when  taken  out  of  context  and  summarized  on  the  cards,  many  requirements 
appearing  to  be  duplicative  were  actually  requesting  different  data  (see  page  9 -Context).  When 
requirements  were  sufficiently  similar  to  be  considered  duplicative,  the  paragraph  numbers  in 
which  they  appeared  were  recorded  along  the  same  row  in  the  appropriate  columns  of  the  chart. 
However,  if  we  Judged  that  the  requirements  were  not  duplicative,  the  paragraph  numbers  were 
recorded  in  the  appropriate  columns  but  in  different  rows  figure  2). 

Requirements  extracted  from  AFBMD  Exhibit  60-1,  Personnel  Subsystem  Testing  For 
Ballistic  Missile  and  Space  Systems  were  listed  separately  because  they  do  not  have  Air  Force 
wide  acceptance. 
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Since  the  method  for  assigning  requirements  to  categories  was  not  entirely  objective,  the 
reader  may  think  that  some  of  the  requirements  were  inappropriately  pigeon-holed.  Catego¬ 
rizing  was  not  intended  to  be  completely  rigid,  but  was  rather  a  tool  to  provide  organization  to  an 
otherwise  unstructured,  confusing  list  of  requirements.  However,  an  objection  of  this  kind  can¬ 
not  be  totally  discounted,  since,  in  some  cases,  a  requirement  could  have  been  classified  in  more 
than  one  category.  For  instance,  paragraph  3. 12.  d  in  MIL- M- 26512 A,  the  maintainability  speci¬ 
fication,  refers  to  reliability  factors  in  the  maintainability  program.  This  requirement  could 
have  been  subsumed  under  either  the  maintainability  category,  becaiue  it  refers  to  the  maintain¬ 
ability  and  is  found  in  the  maintainability  specification,  or  it  may  have  been  appropriately  classi¬ 
fied  in  the  reliability  category.  In  such  cases  it  was  necessary  to  determine  the  category  that 
best  described  the  requirement,  ih  the  above  instance,  the  requirement  was  included  in  the 
reliability  category,  because  the  primary  emphasis  was  on  reliability  rather  than  on  maintain¬ 
ability. 


RESULTS  AND  DISCUSSION 


The  results  of  the  study,  a  list  of  requirements  and  their  locations  in  the  selected  documents, 
are  presented  in  Appendix  I  and  Aiqwndix  H.  Although  a  more  extensive  list  of  requirements 
could  have  been  formulated  and  presented  in  Appendix  1,  the  present  study  focused  only  upon  those 
documents  that  appeared  to  contribute  most  to  the  basic  pool  of  analytical  data  — FED  — thus 
limiting  the  length  of  the  requirements  list.  For  instance,  only  two  requirements  dealing  with 
handbooks  and  manuals  and  very  few  requirements  pertaining  to  mock-ups,  quality  control, 
packaging  and  other  areas  were  included  in  the  list.  Each  of  these  areas  could  have  received 
much  greater  emphasis  had  it  been  deemed  necessary  to  review  and  extract  requirements  from 
those  specifications  that  deal  individually  with  handbooks  and  manuals  (e.  g. ,  MIL-M-005474C, 
MIL-H-6757A),  mock-ups  (e.g. ,  MIL-S-26634),  etc. 

S^ace  limitations  played  a  great  part  in  presenting  a  modified  version  of  the  working  charts 
previously  described.  The  modification  has  in  no  way  changed  the  meaning  and  content  of  the 
requirements  transferred  from  the  working  charts,  and  provides  a  simple  format  for  locating 
desired  information.  The  extracted  requirements  are  documented  on  the  left  side  of  the  list  and 
their  locations,  a  combination  of  a  code  letter  representing  a  particular  document,  and  a  number 
specifying  the  paragraph  within  the  document  in  which  the  requirements  can  be  found,  follow  on 
the  right  side  (e.  g. ,  A- 3. 2  represents  MIL- D- 931  OB,  Data  For  Aeronautical  Weapon  Systems  and 
Support  Systems,  paragraph  3. 2).  If  the  same  or  a  similar  requirement  appears  more  than  once, 
either  be^een  or  within  documents,  the  source  of  each  is  recorded.  The  document  code  list  is 
presented  in  Appendix  L 

The  requirements  extracted  from  the  selected  documents  were  categorized  according  to 
factors  that  groups  of  requirements  had  in  common.  A  list  of  the  empirically  determined  cate¬ 
gories  is  presented  below  to  provide  the  reader  with  a  brief  overview  of  the  possible  confines  of 
FED. 

I.  SYSTEM  REQUIREMENTS 

A.  Operations 

B.  Design 
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n.  PERSONNEL  REQUIREMENTS 


A.  General 

B.  Poeltions 

C.  Manning 

D.  Performance 

Personnel  interaction 

Time 

Tasks 

Environment 

E.  Skills  and  knowledges 

F.  Proficiency 

G.  Training 

H.  Illustrations 

m.  PERSONNEL- EQUIPMENT  REQUIREMENTS 

A.  General 

B.  Facilities 

C.  Work  areas 

D.  Logistics 

E.  Trade-offs 

F.  Safety 

G.  Test 

H.  Performance 

Environment 

Time 

I.  Maintenance  and  maintainability 

J.  RellabUity 

K.  Quality  control 

L.  Failure 

M.  Support  equipment 

N.  Tools  and  test  equipment 

O.  Training  equipment 

P.  Mock-up 

Q.  Displays 

R.  Controls 

S.  Coding 

T.  Illustrations 

U.  Handbooks 

Since  the  requirements  in  ^pendix  I  have  been  abstracted  from  source  documents  and  are 
out  of  context,  the  reader  may  have  some  difficulty  interpreting  or  clearly  understanding  the 
requirements  as  they  are  listed.  Additional  information  and  clarification  concerning  any  of  the 
requirements  can  be  obtained  simply  by  referring  directly  to  the  ^propriate  source  document. 

Perhaps  the  phrase  "out  of  context, "  as  it  appears  in  the  preceding  paragraph,  warrants 
additional  attention.  Once  the  requirements  are  extracted  from  the  specifications  they  seem  to  be 
reduced  to  discrete,  vague,  bits  of  information  scarcely  alluding  to  we^;>on  system  development 
time  phasing  and  do  not  have  a  semblance  of  the  sequential  order  in  which  they  originally  i4>peared 
in  the  specifications.  However,  weapon  system  time  phasing  information  has  been  provided 
throughout  the  requirements  list  whenever  possible.  For  Instance,  information  has  been  included 
in  the  list  to  differentiate  between  requirements  for  design  selection  or  developmental  data. 
Furthermore ,  a  PSS  development  time  phasing  chart,  which  illustrates  sequential  relationship 
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between  PSS  development  and  the  weapon  system  major  milestones,  is  presented  in  figure  3 
(ref.  2).  Since  the  primary  intent  of  this  study  was  to  define  the  limits  of  FED,  it  was  not  deemed 
appropriate  to  present  a  lengthy  discussion  of  time  phasing  and  sequencing  of  requirements  at  this 
time.  If  the  reader  is  particularly  interested  in  obtaining  additional  information  concerning  these 
topics,  he  should  refer  directly  to  the  specifications  and  to  several  PSS  related  Technical  Reports 
(ref.  1,  2,  3). 

The  identification  of  duplicate  requirements  proved  to  be  a  rather  complex  task.  The  original 
Intent  was  to  emphaslae  those  requirements  which  tended  to  generate  duplicate  effort,  but  several 
problems  arose  which  tended  to  complicate  accurate  identification  of  the  requirements.  Since 
these  problems  have  a  bearing  tq>on  the  interpretation  of  the  requirements  list  and  are  somewhat 
distinct,  they  will  be  discussed  individually. 

1.  Apparent  versus  real  d»q)llcation 

a.  Real  duplication  exists  when  more  than  one  military  specification  or  related 
document  used  in  the  same  weapon  system  development  program  contains  the 
same  or  very  similar  requirements.  Unless  these  requirements  are  identified 
early  in  the  program,  usually  at  the  managerial  level,  they  will  tend  to  generate 
redundant  effort. 

b.  Apparent  duplication  is  found  when  several  documents  ordinarily  not  used  in  the 
same  weapon  system  development  program  contain  the  same  or  similar  require¬ 
ments.  For  example,  MIL-H-26207  and  MIL-H-25M6  are  essentially  identical 
documents,  except  that  the  former  pertains  to  human  factors  data  in  guided 
missile  weapon  systems,  whereas  the  latter  is  concerned  with  human  factors  data 
for  manned  aircraft  weapon  systems.  Therefore,  the  requirements  appearing  in 
these  specifications  do  not  amount  to  duplication  in  the  sense  that  they  would 
generate  redundant  effort.  However,  requirements  of  this  nature  have  been 
included  in  the  list  to  reveal  that  they  can  be  found  in  more  than  one  document. 

2.  General  weapon  system  specifications  and  duplicative  requirements 

General  weapon  system  military  specifications  such  as  MIL-D-9310B  and  MIL-W-9411A 
refer  to  other  military  specifications  for  specific  information.  For  example,  para¬ 
graph  3.  4.  8.  2.  c  in  MIL- D- 931  OB  requests  a  "List  of  squadron  manning  by  Air  Force 
Specialty  Code  (AFSC).  This  information  to  be  derived  from  the  Qualitative  Personnel 
Requirements  Information  prepared  in  accordance  with  Specification  MIL- D- 26239.  " 

The  actual  requirement  is  found  in  Appendix  1. 3  of  MIL- D- 26239,  the  QPRI  specifica¬ 
tion.  Although  a  statement  of  this  requirement  is  found  in  both  MIL-D-9310B  and 
MIL-D-26239,  real  duplication  as  defined  above  does  not  exist  in  this  case.  Neverthe¬ 
less,  for  the  purpose  of  the  present  study,  whenever  one  document  requests  data  in 
accordance  with  the  information  appearing  in  other  documents  all  the  locations  should 
be  listed  together.  Although  real  and  apparent  duplication  may  seem  to  be  confounded 
in  the  list  of  requirements,  one  may  note  the  documents  in  which  the  requirement 
appeared;  i.  e. ,  if  one  of  the  requirements  appeared  in  a  general  Military  Specification 
the  duplication  is  probably  apparent  rather  than  real.  The  incorporation  in  the  list  of 
all  the  locations  of  a  requirement  has  the  distinct  advantage  of  directing  the  reader  to 
the  source  documents. 

3.  Context 


An  example  may  best  Illustrate  the  contextual  problem  encountered.  Several  docu¬ 
ments  refer  to  requirements  dealing  with  noise.  If  summary  statements  of  these 
requirements  are  considered  out  of  context,  an  impression  may  be  obtained  that  only 
the  human  element  is  involved,  and  thus  would  be  identified  as  duplicative  and  cate¬ 
gorized  under  Personnel.  However,  a  more  detailed  examination  revealed  that  the 
requirements  relating  to  noise  are  distinctly  different:  first,  noise  as  a  variable  to 
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be  considered  in  the  design  of  equipment  (e.  g.  ,  MIL-W-9411A,  paragraph  3.  2. 10)  and 
secondly,  as  an  environmental  condition  affecting  human  performance  capability 
(e.  g.  ,  MIL-H-26207,  paragraph  3.  2.  3.  7.  d).  Although  somewhat  related,  these  two 
requirements  would  not  generate  duplicative  effort.  Accordingly,  the  former  require¬ 
ment  emphasized  the  human  element  and  was  therefore  placed  in  the  Personnel  cate¬ 
gory. 

4.  Principles  and  criteria 

As  previously  stated,  there  are  times  when  data  is  submitted  to  indicate  adherence  to 
specific  principles  and  criteria  found  in  the  specifications  regardless  of  the  fact  that 
they  are  not  requirements  in  the  strict  sense  and  do  not  necessarily  require  the  sub¬ 
mission  of  data.  For  example,  paragraph  3.  3.  3.  g  of  MIL-M-26512A  states  that  "the 
system  be  designed  for  maximum  safety  for  both  equipment  and  personnel  involved  in 
the  performance  of  maintenance.  "  On  the  other  hand,  paragraph  3. 1.  3.  2  in  MIL-T- 
27382  states  that  a  description  of  safety  features  for  the  system  be  included  in  the 
TEPI  report.  If  we  assume  that  data  is  submitted  in  the  former  case,  then  the  two 
requirements  cited  above  may  be  considered  to  be  duplicative.  Since  data  is  occas¬ 
ionally  submitted  to  indicate  adherence  to  the  principles  and  criteria,  we  thought  that 
this  Information  should  be  included  in  the  list  of  requirements.  In  an  effort  to  avoid 
confusion  and  value  judgments,  all  principles  and  criteria  have  been  identified  in  the 
list  of  requirements  presented  in  Appendix  I. 

The  general  results  of  the  study  have  shown  clearly  that  the  amount  of  real  duplication  be¬ 
tween  and  within  the  documents  examined  was  not  as  extensive  as  anticipated.  In  fact,  if  the  list 
had  been  restricted  exclusively  to  those  requirements  that  would  tend  to  generate  redundant  effort, 
the  amount  of  duplication  recorded  would  have  been  reduced  considerably.  Yet.  the  amount  of 
real  duplication  identified  was  sufficient  to  provoke  a  good  deal  of  concern.  Although  it  may  not 
seem  very  important  if  a  few,  seemingly  trivial  requirements  appear  in  more  than  one  specifi¬ 
cation  and  perhaps  result  in  unnecessary  duplication  of  effort,  some  very  terse  requirements  can 
cause  the  expenditure  of  thousands  of  manhours  of  work;  e.  g. .  identification  of  maintenance  tasks 
(E-3.  3  and  J-3. 1.  3)^  Although  requirements  are  not  identical,  as  was  the  case  in  the  previous 
example,  the  data  derived  to  satisfy  one  requirement  (E-3.  3),  frequently  can  be  used  in  part  to 
fulfill  another  requirement  (J-3. 1.  3). 

What  types  of  conditions  lead  to  duplicate  effort?  Generally  speaking  they  are; 

1.  The  data  needed  is  not  readily  available 

2.  A  group  needing  data  is  not  aware  that  the  data  already  exists 

3.  Poor  management  control 

In  accordance  with  the  example  in  the  above  paragraph,  the  group  concerned  with  the  main¬ 
tenance  aspects  of  the  system  may  describe  the  maintenance  tasks  (E-3.  3).  By  the  same  token, 
the  group  responsible  for  the  preparation  of  TEPI  uses  task  descriptions  as  a  basis  for  their 
report,  and  under  the  conditions  listed  above,  may  replicate  part  of  the  work  done  by  the  main¬ 
tainability  engineers  (J-3. 1,  3)  in  order  to  complete  their  contribution  to  the  system  development 
program. 


Refer  to  page  16  for  the  code  list 
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The  situation  is  further  complicated  in  that  increased  system  complexity  tends  to  create  a 
concomitant  increase  in  the  demand  for  highly  specialized  skills  with  the  resultant  formation  of 
new  working  groups.  At  times,  these  new  working  groups  possess  overlapping  capabilities  and 
responsibilities,  and  without  proper  management  control  the  amount  of  duplication  would  increase 
directly  with  the  additional  Increase  of  working  groups.  Fortunately,  however,  management 
usually  exercises  its  authority  and  delegates  definite  responsibility  for  the  development  of 
certain  data  to  specific  groups  to  avoid  potential  duplication  of  effort. 

Generally,  we  found  that  Air  Force  contractors  are  aware  that  some  work  duplication 
occasionally  occurs  within  their  organizations,  but  have  been  unable  to  cope  with  the  problem 
even  though  they  have  exercised  a  modicum  of  control  over  the  distribution  of  work.  Since  the 
problem  is  partly  due  to  the  duplication  of  requirements  in  various  military  specifications,  many 
contractors  have  taken  it  upon  themselves  to  closely  review  the  specifications  relevant  to  the 
development  of  a  new  weapon  system,  identify  duplicate  requirements,  and  deal  with  them  at  a 
management  level  prior  to  negotiating  with  the  Air  Force.  However,  many  of  the  contractors' 
attempts  to  control  duplication  of  effort  are  abrogated  by  the  assignment  of  overlapping  responsi¬ 
bilities  to  several  working  groups. 

Which  methods  and  techniques  must  be  considered  by  the  Air  Force  and  the  contractors  to 
eliminate  unnecessary  redundant  effort?  The  results  of  the  present  study  suggest  that  a  joint 
Air  Force  — contractor  study  be  initiated  to  analyze  and  integrate  wherever  possible  the  PSS 
related  specifications.  Second,  maximum  communication  should  be  promoted  among  the  working 
groups  in  the  contractors'  organizations.  Consideration  must  also  be  given  to  consolidating 
various  groups  having  common  responsibilities  (e.  g. ,  Personnel  Requirements,  Maintenance 
Engineering,  etc).  Each  working  group  must  be  informed  of  the  other  weapon  system  technical 
groups'  products  and  when  these  data  become  available. 

Finally,  redundant  work  effort  may  be  reduced  through  the  implementation  of  PED.  Should 
the  integration  of  the  various  working  groups  within  an  organization,  as  suggested  above,  present 
too  many  problems  or  be  generally  impractical,  communication  between  groups  can  still  be 
facilitated  through  PED.  PED  can  provide  rapid  retrieval  of  data  generated  by  the  various  groups 
involved  in  a  weapon  system  development  program.  The  existence  of  a  data  pool  or  PED  might 
limit,  but  should  not  necessarily  preclude,  the  many  advantages  attainable  through  personal  con¬ 
tact  among  weapon  system  technical  team  members. 


SUMMARY 


The  Personnel  Subsystem  (PSS)  concept  was  predicated  on  the  need  for  the  development  of 
personnel  support  of  a  weapon  concurrently  with  the  other  aspects  of  the  system.  Personnel- 
Equipment  Data  (PED),  one  of  the  PSS  elements,  has  not  been  adequately  defined  and  is  probably 
the  least  understood  of  the  elements.  Consideration  of  the  degree  of  uncertainty  surrounding  the 
PED  concept  has  indicated  the  need  for  the  present  study.  This  study  is  an  attempt  to  empirically 
define  the  content  of  PED  and  to  identify  those  requirements  appearing  in  selected  military  speci¬ 
fications  and  related  documents  that  could  possibly  generate  unnecessary  duplicative  effort. 

The  task  at  hand  was  to  examine  the  military  specifications  and  related  documents  that  have 
PSS  implications,  and  to  develop  a  technique  for  identifying,  extracting  and  recording  the  require¬ 
ments  contained  therein.  Many  military  specifications,  exhibits,  bulletins,  and  standards  were 
reviewed  and  18  were  selected  as  relevant  to  the  study. 

All  requirements  calling  for  the  submittal  of  data  were  recorded  on  3  by  5  cards  with  the 
specification  number  and  the  paragraph  number  within  the  specification  in  which  the  requirement 
appeared.  The  entire  deck  of  cards  was  sorted  and  similar  requirements  were  placed  in  the  same 
group.  Each  group  of  cards  formed  a  category  and  each  category  was  titled.  A  working  chart  was 
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constructed  so  that  the  information  collected  could  be  scanned  rapidly.  The  columns  in  the  chart 
represented  the  documents  and  the  rows  represented  the  requirements.  If  a  requirement  appeared 
in  more  than  one  document,  entries  were  made  along;  the  same  row,  but  in  different  columns.  The 
working  charts  were  modified  for  presentation  in  the  report. 

The  results  of  the  study,  a  list  of  requirements  and  their  locations  in  the  selected  documents  , 
are  presented  in  the  appendices.  The  extracted  requirements  are  documented  on  the  left  side  of 
the  list  and  their  locations  follow  on  the  right  side.  The  location  of  each  requirement  is  repre¬ 
sented  by  a  combination  of  a  code  letter,  representing  a  particular  document,  and  a  number  speci¬ 
fying  the  paragraph  within  the  document  in  which  the  requirement  can  be  found. 

The  results  of  this  study  have  shown  clearly  that  the  amount  of  duplication  that  would  tend 
to  bring  about  redundant  effort  was  less  than  anticipated,  but  sufficient  to  provoke  a  good  deal  of 
concern.  We  also  found  that  duplication  can  result  either  through  unavailability  of  needed  data, 
unawareness  that  data  already  exists,  or  poor  managerial  control.  Contractors  are  aware  that 
duplication  of  effort  does  occur;  they  have  tried,  but  have  been  unable  to  cope  with  the  problem. 
Elimination  of  duplication  may  possibly  be  achieved  through  a  joint  Air  Force — contractor  study 
of  specifications;  promotion  of  maximum  communication  among  working  groups  in  the  contractor  b 
organization;  consolidating  various  groups  in  the  contractor' s  organization  having  common 
responsibilities;  and  finally,  implementing  PED. 
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AlfalviDIX  I 


LIST  0?  ABBREVIATIONS* 


aOE 

OSE 

4^RI 


Aerospace  around  Equipment 
Ground  Support  Equipment 

Onalitatire  Personnel  Requirements  Information 
qualitative  &  quantitative  Personnel  Require¬ 
ments  Information 

Training  Equipment  Planning  Information 
Svsteis  Proaram  Office 


•The  terms  JSS  and  iPlI  have  been  superseded  by  the  terms  AGE  and 
respectively.  The  terras  which  are  now  out  of  date  have  beer,  used  in  order 
to  remain  consistent  with  older  spec  if  ioatio.as  which  are  still  in  effect. 
The  latest  terms,  as  they  appear  in  recently  written  or  revised  specifi¬ 
cations,  also  are  included  in  Appendix  I. 
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Squipment  identified  ae  new  to  the  Air  Force  D-App  I.4/4*‘l«4 

( in  accordance  with  MIL-D-94i2} 


Difference  between  new  equipment  and  eimilar  equip-  D-^PP  I.4A-1-.2.3*® 

ment  in  other  systems 
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Anticipated  requirements  for  unique  facilities  J-3. 1.1,1 

(buildings,  power,  etc.)  generated  by  the  proposed 
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Probable  equipment  availability  3-3. 1.4. 
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Syatea  test  and  evaluation  program  A-3.I.5 
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System  acceptance  test  procedures  that 
describe  tests  to  be  used  as  acceptance 
criteria 
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ystesi  suitability  tests  for  3SE  C-3.7 
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Reliability  (as  a  factor  affecting 
operational  requirements  that  may  be 
pertinent  to  design  trade-offs) 
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Special  considerations  associated  with 
training  equipment  being  proposed 
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drawings  and  sketches  of  the  L-3*5*^*4 
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Squadron  facilities  layout  A-3.4.8.2.b 
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appendix  II 


PERSONNEL  SUBSYSTEM  TEST  AND  EVALUATION 
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Failure,  consumption  data,  hazards,  accident, 
safety,  etc.  reports  shall  be  utilized  to  collect 
data  that  have  PSS  implications 
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Effect  of  equipment  arrangement  on  crew  efficiency 
including  such  items  as  information  flow 
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PSS  test  reports  shall  be  submitted  in  accordance  3 *9 *2 

with  test  reporting  procedures  in  the  Contractor 
Reports  Exhibit  (AFK'1  58-1) 
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